Objective Evaluation of Subjective Metrics for Interactive Decision-Making Tasks by Non-experts

Interactive Multiple Objective Decision Making based on Quadratic Programming

In order to make a decision in the face of multiple objectives it is necessary to know the relative importance of the different objectives. Yet, it is often very difficult to specify a set of precise weights before possible alternatives solutions are known. In this paper, we present an interactive, iterative method for arriving at an acceptable solution. The decision maker gradually discerns wh...

Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review

Background Patient, public, consumer, and community (P2C2) engagement in organization-, community-, and systemlevel healthcare decision-making is increasing globally, but its formal evaluation remains challenging. To define a taxonomy of possible P2C2 engagement metrics and compare existing evaluation tools against this taxonomy, we conducted a systematic review.   Methods A broad search strate...

Decision-Making Tasks

Multi-Objective Decision Making

Many real-world tasks require making decisions that involve multiple possibly conflicting objectives. To succeed in such tasks, intelligent systems need planning or learning algorithms that can e ciently find di↵erent ways of balancing the trade-o↵s that such objectives present. In this tutorial, we provide an introduction to decision-theoretic approaches to coping with multiple objectives. We ...

Objective Evaluation of Subjective Decisions

The Dempster-Shafer “theory of evidence” encompasses and extends the Bayes Theorem-based decision making machinery. Dempster-Shafer’s innovation is the introduction of lower and upper bounds, designated “belief” and “plausibility”, that are attached to probability estimates. The Dempster-Shafer algebra provides for propagation of and reasoning about these quantities according to an algebra whos...